o 
o 

(N 

1—5 

in 

(N 



Probing Electroweak Top Quark Couplings at Hadron and Lepton 
Colliders 

U. Baur**, A. Juste*^, L. H. Orr'^ and D. Rainwater'^ 

'"Physics Department, State University of New York at Buffalo, Buffalo, NY 14260, USA 
*Termi National Accelerator Laboratory, Batavia, IL 60510, USA 

"^Department of Physics and Astronomy, University of Rochester, Rochester, NY 14627, USA 



(N 

\o 
o 
\o 
o 



X 



We discuss possibilities to measure the tt-y and ttZ couplings at hadron and lepton colliders. We also briefly 
describe how these measurements can be used to constrain the parameter space of models of new physics, in 
particular Little Higgs models. 



1. Introduction 

Although the top quark was discovered almost 
ten years ago [1,2], many of its properties are 
still only poorly known [3]. In particular, the 
couplings of the top quark to the electroweak 
(EW) gauge bosons have not yet been directly 
measured. Current data provide only weak con- 
straints on the couplings of the top quark with 
the EW gauge bosons, except for the ttZ vec- 
tor and axial vector couplings which are rather 
tightly but indirectly constrained by LEP data; 
and the right-handed tbW coupling, which is 
severely bound by the observed b sj rate [4] . 

At an e"'"e~ linear collider with y/s = 500 GeV 
and an integrated luminosity of 100 — 200 fb^^ 
one can hope to measure the ttV {V — 7, Z) cou- 
plings in top pair production with a few-percent 
precision [5]. However, the process e+e^ — > 
7*/Z* ti is sensitive to both ^7 and ttZ cou- 
plings and significant cancellations between the 
various couplings can occur. At hadron collid- 
ers, ti production is so dominated by the QCD 
processes qq ^ g* ^ ti and gg ti that a 
measurement of the ttj and ttZ couplings via 
qq 7*/Z* ti is hopeless. Instead, the 
ttV couplings can be measured in QCD ti-y pro- 
duction, radiative top quark decays in ti events 
{tt -fW+W-bb), and QCD tiZ production [6]. 
ti'y production and radiative top quark decays are 



sensitive only to the tt^ couplings, whereas tiZ 
production gives information only on the struc- 
ture of the ttZ vertex. This obviates having to 
disentangle potential cancellations between the 
different couplings. 

Here we briefly discuss the measurement of the 
ttV couplings at the LHC and compare the ex- 
pected sensitivities with the bounds which one 
hopes to achieve at an e+e^ linear collider. 

2. General ttV Couplings 

The most general Lorentz-invariant vertex 
function describing the interaction of a neutral 
vector boson V with two top quarks can be writ- 
ten in terms of ten form factors [7], which are 
functions of the kinematic invariants. In the low 
energy limit, these correspond to couplings which 
multiply dimension-four or -five operators in an 
effective Lagrangian, and may be complex. If V 
is on-shell, or if V couples to effectively massless 
fermions, the number of independent form fac- 
tors is reduced to eight. If, in addition, both top 
quarks are on-shell, the number is further reduced 
to four. In this case, the ttV vertex can be written 
in the form 

r;,*^(fc^ q, q) = -leL, {PUk^) + l.FYAk^)) 



('? + 9T Wy(fc') + 75Fj:,(fc^))|, (1) 
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where e is the proton charge, rrit is the top quark 
mass, q (g) is the outgoing top (anti-top) quark 
four-momentum, and fc^ = {q + ([f- The terms 
FYy{Q) and -Fi^(O) in the low energy hmit are 
the ttV vector and axial vector form factors. The 
coefBcients J^^y(O) and -F^^(O) arc related to the 
magnetic and (CP-violating) electric dipole form 
factors. 

3. tt7 Production at the LHC 

The most promising channel for measuring the 
tt-y couplings at the LHC is pp j£i/ebbjj, 
which receives contributions from tt-y production 
and ordinary tt production where one of the top 
quarks decays radiatively {t Wbj). In order to 
reduce the background, it is advantageous to re- 
quire that both &-quarks are tagged. We assume a 
combined efficiency of = 40% for tagging both 
6-quarks. 

The non-resonant pp W{—f iv)yhhjj back- 
ground and the single-top backgrounds, {thy + 
thy) + X, can be suppressed by imposing invari- 
ant and transverse mass cuts which require that 
the event is consistent either with tiy produc- 
tion, or with tt production with radiative top 
decay [6]. Imposing a large separation cut of 
Ai?(7, h) > 1 reduces photon radiation from the h 
quarks. Photon emission from W decay products 
can essentially be eliminated by requiring that 
m{jjy) > 90 GeV and mT{£r,^T) > 90 GeV, 
where m{jjy) is the invariant mass of the jjy 
system, and mT{iy;i>x) is the iy^j- cluster trans- 
verse mass, which peaks sharply at mw- After 
imposing the cuts described above, the irreducible 
backgrounds arc one to two orders of magnitude 
smaller than the signal. 

The potentially most dangerous reducible back- 
ground is ttj production where one of the jets 
in the final state fakes a photon. In Fig. la 
we show the photon transverse momentum dis- 
tributions of the tty signal and the backgrounds 
discussed above. The ttj background is seen to 
be a factor 2 to 3 smaller than the tiy signal 
for the jet - photon misidcntification probability 
{Pj^^ = 1/1600 [8]) used. 

The photon transverse momentum distribu- 
tions in the SM and for various anomalous tty 



couplings, together with the pxiy) distribution 
of the background, are shown in Fig. lb. Only 
one coupling at a time is allowed to deviate from 
its SM prediction. 

4. tiZ Production at the LHC 

The process pp tiZ leads to either 

£''^£'~£Mjj or £'^£'~bb + 4j final states if the 
Z-boson decays leptonically and one or both of 
the W bosons decay hadronically. If the Z boson 
decays into neutrinos and both W bosons decay 
hadronically, the final state consists of '^j.hb + Aj. 
Since there is essentially no phase space for t — > 
WZb decays {BR{t WZh) « 3- 10"^ [9]), these 
final states arise only from ttZ production. 

In order to identify leptons, b quarks, light jets 
and the missing transverse momentum in dilep- 
ton and trilepton events, the same cuts as for 
ti-y production are imposed. One also requires 
that there is a same-flavor, opposite-sign lepton 
pair with invariant mass near the Z resonance, 
mz - 10 GeV < m{££) <mz + lQ GeV. 

The main backgrounds contributing to the 
trilepton final state are singly-resonant {tbZ -\- 
ibZ) + X (tbZjj, ibZjj, tbZ£v and ibZtv) and 
non-resonant WZbbjj production. In the dilep- 
ton case, the main background arises from Zbb + 
Aj production. To adequately suppress it, one ad- 
ditionally requires that events have at least one 
combination of jets and b quarks which is consis- 
tent with the bb + 4:j system originating from a 
tt system. Once these cuts have been imposed, 
the Zbb + 4j background is important only for 
PriZ) < 100 GeV. 

The Z boson transverse momentum distribu- 
tion for the trilepton final state is shown in Fig. 2a 
for the SM signal and backgrounds, as well as 
for the signal with several non-standard ttZ cou- 
plings. Only one coupling at a time is allowed 
to deviate from its SM prediction. The back- 
grounds are each more than one order of mag- 
nitude smaller than the SM signal. Note that 
varying F^y ^ leads mostly to a cross section nor- 
malization change, hardly affecting the shape of 
the pt{Z) distribution. 

For the '^j.bb + Aj [10] final state at least 3 jets 
withpT > 50 GeV andj^^ > 5 GeV^/^ ^'^Pr are 
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Figure 1. The differential cross sections as a function of the photon transverse momentum for jiuibbjj 
production at the LHC. Part a) shows the SM signal and the various contributions to the background. 
Part b) shows the SM signal and background, and the signal for various anomalous ttj couplings. 




Figure 2. a) The differential cross sections at the LHC as a function of pt{Z) for £' i' ii^bbjj final 
states. Shown are the SM predictions for ttZ production, for several non-standard ttZ couplings, and 
for various backgrounds. Only one coupling at a time is allowed to deviate from its SM value, b) The 
differential cross sections as a function of the missing transverse momentum for ;^rpbb + 4j production at 
the LHC. Shown are the SM predictions for ttZ production and for various backgrounds. 
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required. The largest backgrounds for this final 
state come from tt and bb + Aj production where 
one or several jets are badly mismcasurod, from 
pp tijj with ti i^fibbjj and the charged 
lepton being missed, and from tij production, 
where one top decays hadronically, t — > Wb — > 
bjj, and the other via t Wb TVrb with the 
r-lepton decaying hadronically, r hur- 

In Fig. 2b we show the missing transverse mo- 
mentum distributions of the SM ttZ ^^,66 + 4j 
signal (solid curve) and various backgrounds. The 
most important backgrounds are tijj and tij pro- 
duction. However, the missing transverse mo- 
mentum distribution from these processes falls 
considerably faster than that of the signal, and 
for ^j, > 300 GeV, the SM signal dominates. 

5. Sensitivity Bounds for ttV Couplings: 
LHC and ILC 

The shape and normalization changes of the 
photon or Z-boson transverse momentum distri- 
bution can be used to derive sensitivity bounds 
on the anomalous tt"/ and ttZ couplings. For fIZ 
production with Z the distribution of 

the £'^i~ opening angle in the transverse plane, 
A^{££), provides additional information [6]. In 
the following we assume a normalization uncer- 
tainty of the SM cross section of AjV = 30%. 

Even for a modest integrated luminosity of 
30 fb~^, it will be possible to measure the tt^f 
vector and axial vector couplings, and the dipole 
form factors, with a precision of typically 20% 
and 35%, respectively. For 300 fb~^, the hmits 
improve to 4 — 7% for F^y ^ and to about 20% 
for F^y^. 

To extract bounds on the ttZ couplings, we 
perform a simultaneous fit to the Pt{Z) and the 
A$(^'£') distributions for the trilcpton and dilcp- 
ton final states, and to the distribution for 
the '^j,bb + 4:j final state. For an integrated lumi- 
nosity of 300 fb~^, it will be possible to measure 
the ttZ axial vector coupling with a precision of 
10 - 12%, and Fj^^ with a precision of 40%. 
At the SLHC, assuming an integrated luminosity 
of 3000 fb~^, these bounds can be improved by 
factors of about 1.6 {F^v,a) and 3 {Fl^). The 
bounds which can be achieved for Ff,r are much 



weaker than those projected for Ffj^. As men- 
tioned in Sec. 4, the pt{Z) distributions for the 
SM and for Ffy = —F^y^^ are almost degener- 
ate. This is also the case for the A$(^'^') distribu- 
tion. In a fit to these two distributions, therefore, 
an area centered at AF^^^ = —2F^y^^^ remains 
which cannot be excluded, even at the SLHC. For 
F^y, the two regions merge, resulting in rather 
poor limits. 

It is instructive to compare the bounds for 
anomalous ttV couplings achievable at the LHC 
with those projected for the ILC. The most com- 
plete study of ti production at the ILC for gen- 
eral ttV iy — "f, Z) couplings so far is that of 
Ref . [5] . Note that only one coupling at a time is 
allowed to deviate from its SM value in Ref. [5]. 
Comparing the projected LHC and ILC sensitiv- 
ity bounds, one finds [11] that, oven if the SLHC 
operates first, and the ^j,bb+4j final state is taken 
into account, a linear collider will still be able to 
significantly improve the ttZ anomalous coupling 
limits, with the possible exception of J^j^i- The 
ILC will also be^able to considerably strengthen 
the bounds on F^j^ and f^A- should be noted, 
however, that this picture could change once cor- 
relations between different non-standard ttZ cou- 
plings, and between tt-)- and ttZ couplings, are 
taken into account. Unfortunately, so far no re- 
alistic studies for e+e~ — > ti which include these 
correlations have been performed. 

6. Model Implications 

Many models of new physics predict anomalous 
ttZ couplings. Examples are top-seesaw mod- 
els [12] and Little Higgs models [13], which pre- 
dict an up-type quark singlet T which mixes with 
the top quark. This changes coupling of the left- 
handed top quark to the Z-boson: 

AFfy = - AFfi = Ff/^ sin^ (2) 

where 9l is the T — t mixing angle. 

It is straightforward to derive bounds for 
sin^ 6l from the general limits on F^j^ outlined 
in Sec. 5. With 300 fb~^, sin^ 6l can be restricted 
to 

sin^ 6»L < 0.084 (0.16) at 68.3% (95%) CL.(3) 
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At the SLHC it will be possible to improve these 
bounds by about a factor 2.8. 

In the SU{5)/SO{5) Littlest Higgs model with 
T-parity [14], sin^ 6*^ is related to the mass of 
the heavy top quark partner, T, the tTh coupling 
{h is the Higgs boson), At, and the SM Higgs 
vacuum expectation value, v w 246 GeV, by 



In this model, the bounds on sin^ 6l can be con- 
verted into limits on m,T/XT- For 300 fb~^ one 
finds [15] 

^ > 600 (430) GeV at 68.3% (95%) CL.(5) 

Since the LHC should be able to discover a T 
quark with a mass of niT < 2 TeV [16], a mea- 
surement of can provide valuable information 
on At- 

7. Conclusions 

The LHC will be able to perform first tests of 

the ttV couplings. Already with an integrated 
luminosity of 30 fb~^, one can probe the ttj cou- 
plings with a precision of about 10 — 35% per 
experiment. With higher integrated luminosities 
one will be able to reach the few percent region. 
The LHC will also be able to probe the ttZ cou- 
plings, albeit not with the same level of precision. 
However, a measurement of F^^i "^'^^^ constrain the 
parameter space of models with an extra up-type 
singlet quark, such as Little Higgs models. The 
ILC will be able to further improve our knowl- 
edge of the ttV couplings, in particular in the ttZ 
case. 
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